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BACKGROUND OF THE INVENTION 

1 0 Field of the Invention: 



The present invention relates to systems and methods for target tracking and 
imaging. More specifically, the present invention relates to synthetic aperture ladar 
systems. 

15 

Description of the Related Art : 

The resolution of a typical conventional radar system is dependent on the 
antenna size. Accordingly, unless the antenna diameter is quite large, the resolution is 
20 low. Synthetic aperture radar (SAR) provides a larger effective antenna size by virtue 
of the movement of the aperture relative to the target and integration of the returns from 
the target. 

However, current and future applications will require further improvements in 
resolution, particularly angular resolution, to achieve longer range and improved 
25 imagery. This need is addressed somewhat by synthetic aperture ladar (SAL). SAL 
systems are similar to radar systems with the exception that a laser pulse is transmitted 
as opposed to a radio wave. However, SAL systems tend to be too complex and costly 
for many current and future applications. 

Further, current synthetic aperture ladar approaches are based largely on existing 
30 synthetic aperture radar systems operating in the millimeter wave regime. These 



approaches use coherent heterodyne processing to extract precise Doppler information 
from the target signal, which is then synthesized into a high resolution angle-angle- 
range image using SAR image formation algorithms. Phase errors resulting from 
nonlinear flight trajectories are compensated using SAR auto-focus algorithms that 
5 work quite well in the millimeter regime, but may be difficult to implement at optical 
wavelengths, where the required sensitivity is increased several orders of magnitude. 

Accordingly, a need exists in the art for a more simple and less costly system or 
method for providing improved resolution in a target tracking and optical imaging 
application. Furthermore, there is a need for an alternative for those applications that do 
10 not require three-dimensional imagery for which high-resolution angle-angle images 
will suffice. 

SUMMARY OF THE INVENTION 

15 

The need in the art is addressed by the system and method of the present 
invention. In a most general implementation, the invention provides an imaging system 
mounted on a mobile platform. The system is adapted to receive a beam of 

20 electromagnetic energy; record an image provided by the beam; and compensate the 
image for motion of the platform relative to an inertial reference. 

In the illustrative embodiment, the system is a synthetic aperture ladar and the 
amplitude and phase patternis stored as a holographic interference pattern or hologram. 
The system includes one or more mutually coherent lasers used to illuminate the target 

25 scene and provide a reference beam for a holography process, a re-imaging telescope 
which receives the intensity and phase information from the illuminated scene, a back- 
scan mirror located at the infinity-focus image plane of the re-imaging telescope which 
compensates the stored holographic pattern for motion of the platform, a holographic 
recording medium, a coherent laser used to read the hologram which may be the same 

30 as the illumination and/or reference laser, and an imaging optical system capable of 
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focusing the holographic pattern at a focal plane where the image of the target can be 
viewed or sensed with a focal plane array. Consequently, a relayed image of the 
aperture plane is continuously stored. In this embodiment, the instantaneous location of 
the received beam on the recording medium is controlled to compensate for motion of 
5 the platform. 

In the best mode, the holographic recording medium is re-recordable and may 
use a liquid crystal spatial light modulator, photorefractive crystal, or other suitable 
recording medium. The holographic recording medium may also use a conventional 
photographic film, which may be developed and read in a subsequent process. 

10 An optical phase adjuster may be used to control the instantaneous phase of the 

coherent reference beam relative to the illumination beam in order to compensate phase 
errors in the return signal caused by nonlinear platform motion in the yaw plane of the 
platform and/or frequency offsets caused by the average Doppler shift in the return 
signal if the sensor line-of-sight is not precisely at a right angle to the average platform 

15 velocity vector. 

A second axis may be included in the back-scan mirror, which is also used to 
compensate non-linear platform motion in the vertical direction. 

Additional gimbal apparatus may be used to inertially stabilize the orientation of 
the SAL system in one or more angular degrees of freedom. 

20 In an alternative embodiment, the back-scan mirror is eliminated, the medium is 

replaced with a video camera, and the read laser and imaging optical system is replaced 
with a holographic processing algorithm in a computer. One-dimensional and two- 
dimensional arrays may be used within the video camera. In a specific embodiment, a 
two-dimensional array is used with a "time delay and integration" scheme which 

25 compensates for motion of the platform relative to the target in the storage of the optical 
signals. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. la is a diagram which illustrates the principle of operation (target 
5 illumination geometry) of traditional synthetic aperture ladar from a moving platform. 

Fig. lb shows Doppler frequency of the target return for the SAR system of 

Fig. la. 

Fig. lc shows a matched filter characteristic typically employed in the 
conventional SAR imaging system. 
10 Fig. Id shows a typical output of the matched filter of Fig. lc. 

Fig. 2a is a top view of an illustrative embodiment of a synthetic aperture 
ladar (SAL) system implemented in accordance with the teachings of the present 
invention at a first position relative to a target. 

Fig. 2b is a side view of the SAL system of Fig. 2a. 
15 Fig. 2c is a top view of the SAL system of Fig. 2a at a second position relative 

to a target. 

Fig. 3a is a top view of an illustrative arrangement for reading out an 
interference pattern stored on the holographic medium in accordance with the 
teachings of the present invention. 
20 Fig. 3b is a side view of the illustrative arrangement for reading out an 

interference pattern stored on the holographic medium of Fig. 4a in accordance with 
the teachings of the present invention. 

Fig. 4 shows a preferred embodiment of the present invention wherein the 
phase of the reference beam used to write the hologram is controlled by means of an 
25 external phase adjuster. 

Figure 5a shows the target and platform geometry and nomenclature as used in 
computing the commands to the phase adjuster, back-scan mirror, and line-of-sight 
control system. 
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Fig. 5b is a flow diagram of software coded to run on a computer used to control 
the phase adjuster, back-scan mirror, and line-of-sight control system of the synthetic 
aperture system of the present invention. 

Fig. 6 shows an alternative embodiment of the SAL system of the present 
5 invention using real time digital holography. 

Fig. 7 shows a second alternative embodiment of the SAL system in 
accordance with the present teachings with real time digital holography and time 
delay and integration. 

Fig. 8a is a diagram which illustrates a linear array used in a parallel scan 
10 imaging mode in accordance with conventional teachings. 

Fig. 8b is a diagram which illustrates time delay and integration processing 
with a two-dimensional array used in a parallel scan mode in accordance with 
conventional teachings. 
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DESCRIPTION OF THE INVENTION 

Illustrative embodiments and exemplary applications will now be described with 
5 reference to the accompanying drawings to disclose the advantageous teachings of the 
present invention. 

While the present invention is described herein with reference to illustrative 

embodiments for particular applications, it should be understood that the invention is 

not limited thereto. Those having ordinary skill in the art and access to the teachings 
10 provided herein will recognize additional modifications, applications, and embodiments 

within the scope thereof and additional fields in which the present invention would be 

of significant utility. 

The objective of a synthetic aperture ladar (SAL) is to synthetically increase the 

effective aperture of the laser radar in order to increase the azimuth resolution of the 
15 image. The theory of operation of a traditional synthetic aperture radar or ladar based 

on coherent processing of the Doppler-shifted return signal is shown schematically in 

Figs. la-c. 

Fig. la is a diagram which illustrates the principle of operation (target 
illumination geometry) of traditional synthetic aperture ladar from a moving platform. 

20 The SAL system is located on a moving platform such as an aircraft and views a 
certain instantaneous field of view (IFOV) through a physical aperture. The platform 
motion translates the physical aperture in the azimuth direction as it scans past the 
target, displacing the IFOV over time. In the simplest embodiment, the target is a 
single glint return and the ladar transmitter sends out a single tone. After reflection 

25 from the target, the transmitted signal is shifted in frequency due to the relative 
motion between the SAR platform and the target. This effectively chirps the return 
signal in frequency such that information containing the precise azimuth location of 
the target is encoded within the frequency vs. time function, as measured by a 
heterodyne receiver within the SAL. 
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This is illustrated in Fig. lb which shows Doppler frequency of the target 
return for the SAR system of Fig. la. Fig. lc shows a matched filter characteristic 
typically employed in the conventional SAR imaging system. Fig. Id shows a typical 
output of the matched filter of Fig. lc in response to the chirp signal of Fig lb. The 
5 frequency vs. time function of Fig. lb is processed using conventional matched 
filtering techniques, usually performed digitally (Fig. lc) and the resultant amplitude 
vs. time function provides a narrow peak corresponding to the precise azimuth 
location of the target (Fig Id). The matched filter processing is known in the art as 
"azimuth compression" and provides a sensor resolution that is beyond the diffraction 

10 limit of the physical aperture of the system. More complex illumination waveforms 
and signal processing may be used to simultaneously provide target range information 
for a three-dimensional synthetic image of the target. 

Unfortunately, the processing required for modern pulse compression 
synthetic aperture ladar systems is expensive and extremely complex. For example, 

15 very wide bandwidth analog-to-digital converters are generally required to convert the 
spread-spectrum data from the heterodyne receiver into digital format for processing 
and processor intensive auto-focus algorithms are used to compensate the effect of 
nonlinear target motion and atmospheric phase distortion. Hence, an objective of the 
present invention is to provide a high resolution synthetic aperture image without the 

20 cost and processing complexity inherent in traditional SAL systems. 

The present invention provides an apparatus and method for creating a real- 
time high-resolution synthetic aperture ladar (SAL) image of a target scene from a 
moving platform at potentially lower cost and with less processing complexity than 
traditional SAL systems and techniques. It provides an improvement over prior 

25 holographic SAL approaches by implementing platform motion and phase error 
compensation. 

An exemplary embodiment of the present invention is shown in Figs. 2 a-c. 
Fig. 2a is a top view of an illustrative embodiment of a synthetic aperture ladar (SAL) 
system implemented in accordance with the teachings of the present invention at a 
30 first position relative to a target. Fig. 2b is a side view of the SAL system of Fig. 2a. 
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Fig. 2c is a top view of the SAL system of Fig. 2a at a second position relative to a 
target which corresponds to a later time. 

As illustrated in Figs. 2a-c, a target located at some range from a platform (not 
shown) on which the inventive SAL system 10 is mounted is illuminated by beam 
5 from a coherent laser 12 through a physical aperture (first aperture plane) 14 that is 
fully shared with the receiver portion of the SAL. As in the traditional SAL 
approach, the coherent laser beam 1 1 illuminates a large instantaneous field of view 
(not shown) such that the target remains illuminated as the moving platform causes 
the SAL system to translate from right to left in the figure. The return signal is 

10 received through the shared aperture and is focused by a focusing lens 16 to a primary 
focus, which is located at the pivot location of a one-dimensional scan (or back-scan) 
mirror 20. Those skilled in the art will appreciate that the focusing lens 16 may be a 
single refractive element as shown, a lens group, or may include reflective or 
diffractive elements without departing from the scope of the present teachings. The 

15 focusing lens or group 16 may be fixed in focus or may use means known in the art to 
adjust the focus in order to compensate for compliance and/or thermal changes in the 
SAL system structure, as required by a specific application. The focus of the focusing 
lens or group 16 is fixed at infinity and is not adjusted for target distance. A 
beamsplitter 17 is disposed within the ray path of focusing lens or group 16 to deflect 

20 a portion of beam 1 1 from a coherent laser 12 toward the target. A negative lens or 
group 21 may be included in the laser beam path 11 which, in conjunction with 
focusing lens or group 16, results in a substantially collimated laser beam to 
illuminate the target. A scan mirror 20 is located such that its pivotal axis is 
substantially perpendicular to the average platform velocity vector and at the infinity 

25 focus plane of focusing lens or group 16. A collimating lens (or lens group) 22 is 
disposed after the scan mirror 20 which relays the first aperture plane 14 (which may 
be coincident with the focusing lens 16) to a second aperture plane 24. This second 
aperture plane 24 may be relayed at a different magnification than the first aperture 
plane 14 by tailoring the ratio of the focal lengths of the focusing and collimating 

30 lenses 16 and 22, respectively. A thin holographic recording medium 26 is disposed 
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at the second aperture plane 24. In a preferred embodiment, the second aperture plane 
24 is demagnified (i.e., smaller) with respect to the first 14 thereby reducing the size 
requirement of the holographic recording medium 26. The holographic recording 
medium 26 may be a static medium such as a photographic film or may be any 
5 persistent real-time non-linear optical recording medium such as a thin liquid crystal 
layer, a photo-refractive element such as crystalline barium titanate, or other means 
known in the art capable of writing a diffraction grating with two interfering optical 
beams in real time. In the best mode, the recording medium 26 is re-recordable. 

Placing the infinity focus 19 of focusing lens or group 16 at the pivot point on 

10 the scan mirror 20 ensures that motion of the platform is adequately compensated at 
the second aperture plane 24 such that the relayed pupil is translated across the 
holographic recording medium as the platform motion causes the intensity and phase 
profile of the target return beam to translate across the first aperture plane. 

In the side view of the holographic SAL apparatus of Fig. 2b, a reference 

15 beam 13 is derived from the coherent laser 12 and used to record a holographic 
interference pattern on the medium 26 as it interferes with the return beam. A portion 
of the beam from the coherent laser is split using a switchable beamsplitter 27, which 
may be implemented with a Fresnel reflection off a coated optical surface. This 
portion becomes the reference beam 13, which is directed to and focused on the scan 

20 mirror 20 at the pivot location 19 by a focusing lens 28 and fold mirrors 29 and 18. 
The reference beam 13 is offset from the return beam on the scan mirror in order to 
provide an angular offset between the reference beam 1 1 and the return beam at the 
second aperture 24 where the holographic recording medium 26 is disposed. The 
angular offset is chosen to provide a high fidelity interference pattern at the 

25 holographic recording medium. In this configuration, the reference beam spot is also 
translated across the holographic recording medium along with the second aperture 
pupil, providing a high fidelity interference pattern only across the instantaneous 
pupil location and essentially no illumination anywhere else on the holographic 
recording medium thereby avoiding washout of the holographic pattern. The image 

30 should be maintained stable over the recording time. Those skilled in the art will 
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appreciate that this will require the designer to take into account the sensitivity of the 
medium, the speed of the vehicle and the power of the laser beam. Unless otherwise 
indicated herein, all components may be of conventional design and construction, the 
specifications for which would be chosen in accordance with the requirements of the 
5 application using conventional teachings. The laser should provide a beam of 
sufficient power for the application and should be coherent over the recording interval 
(i.e. while the platform is moving between positions 1 and 3), 

When the inventive SAL system 10 is located such that the first aperture is at 
position 1, as shown in Fig. 2a, the holographic recording medium 26 records the 

10 phase and intensity information from the pupil region at this first aperture location 
through the traditional holographic process known in the art. Some time later, the 
platform moves such that the first aperture 14 is at position 2, as shown in Fig. 2c. At 
this time, the holographic recording medium 26 records the phase and intensity 
information at a new pupil location 32 that is displaced by a distance equivalent to the 

15 target motion as magnified or demagnified by the focusing and collimating lens 
systems. The new pupil location is selected by a SAL controller 40 which adjusts the 
rate of the scan mirror 20 through a conventional continuous drive motor, motor drive 
circuit and mechanical linkage (not shown). The SAL controller 40 may be 
implemented in hardware via analog or digital circuits or in software using a program 

20 such as that illustrated in the flow diagram of Fig. 5. 

The phase and intensity information recorded in this manner is the same as it 
would be if the target were viewed at a single time through a larger physical aperture 
but with no platform motion. 

Figs. 3a and 3b show an exemplary embodiment of the holographic readout 

25 process as applied to the present invention. Fig. 3a is a top view of an illustrative 
arrangement for reading out a phase and intensity pattern stored on the holographic 
medium in accordance with the teachings of the present invention. 

Fig. 3b is a side view of the illustrative arrangement for reading out a phase 
and intensity pattern stored on the holographic medium of Fig. 3a in accordance with 

30 the teachings of the present invention. During readout, the beam from the coherent 
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laser 12 is directed along a separate optical path that does not reflect off the scan 
mirror. The beam may be redirected by flipping beamsplitter 27 or by employing 
other opto-mechanical or electro-optical means known in the art to change the line of 
sight. This beam becomes the reference beam used to read the hologram and is 
5 focused and recollimated as needed to fully fill the entire recorded pattern on the 
holographic recording medium. The recording medium of this illustrative 
arrangement is chosen to provide a transmission hologram, however other 
arrangements known in the art may be used with reflective holographic media. An 
optical camera 50 is disposed behind the holographic recording medium and the focal 

10 plane array 54 of the camera 50 is positioned at the focal plane 57 such that it receives 
the image of the target via a focusing lens 52. The focusing lens is moveable in order 
to compensate for target range and provide a clear, sharp image of the target at the 
focal plane 57. This image has an azimuth resolution that is determined by the 
synthetic aperture size, and not by the physical aperture of the SAL system. 

15 Fig. 4 shows a preferred embodiment of the present invention wherein the 

phase of the reference beam used to write the hologram is controlled by means of an 
external phase adjuster 58. The phase adjuster 58 may be implemented with a non- 
linear electro-optic crystal such as Lithium Niobate (LiNBO,) or other comparable 
means known in the art. The phase adjuster 58 generates a phase difference between 

20 the return beam from the target and the reference beam, which interfere in the 
holographic medium. This phase difference is used to compensate for phase error 
produced by nonlinear platform motion. That is, the phase adjuster 58 changes the 
optical path length of the reference beam 13 while it records information on the 
holographic recording medium 26. This offsets the effect of changes in the optical 

25 path length of the illumination beam to and from the target and yields a stable 
interference pattern at the holographic recording medium 26. The phase offset 
command is derived by the SAL controller 40 from inertial measurements taken 
during the hologram formation process and gimbal angles from the line-of-sight 
(LOS) control system and is applied to the reference beam through the phase adjuster 
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in real time. This process provides the same function as auto-focus in traditional 
synthetic aperture radar systems. 

Figure 5a shows the geometry of the synthetic aperture ladar sensor in 
relationship to the target, the instantaneous platform velocity vector, and the time- 
5 averaged platform velocity vector used in the equations of Fig. 5b. 

Fig. 5b is a flow diagram of software coded to run on a computer controller 40 
used to control the phase adjuster 58, back-scan mirror 20, and pointing angles of the 
LOS control system (not shown) of the synthetic aperture ladar system 10 of the present 
invention. The phase error measured in waves of optical pathlength difference (OPD) 
10 used to command the phase adjuster 58 is computed in accordance with the following 
equation: 

Phase Error = f 2 * 1 V| 1 cos 6 dt 

\ * 

where: |vj is the absolute value or magnitude of instantaneous platform velocity 
vector at the time of the present measurement, t; 

0 is the angle between the instantaneous platform velocity vector and the 
15 sensor line-of-sight (LOS) pointing vector; 

X is the wavelength of the coherent laser 12; and 

the integral is taken over the interval from the start of the synthetic aperture 
integration period, t 0 , until the present measurement time, t. 
The angular rate used to command the back- scan mirror is computed in accordance 
20 with the following equation: 

<t>- t^t 

where: <|> is the angle of the backscan mirror; 

vix is the vertical component of the instantaneous platform velocity vector in 
sensor coordinates; and 

and f is the focal length of the focusing lens 16. 
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The azimuth angle used to command the LOS control system 42 is calculated such 
that the sensor LOS vector remains perpendicular to the average platform velocity 
vector in the horizontal plane and is inertially stabilized in the vertical plane. 

Fig. 6 shows an alternative embodiment of the SAL system 10 of the present 
5 invention using real time digital holography. Digital holography is a process whereby 
holographic information is recorded using an electronic camera and the object wave is 
reconstructed using digital electronic image processing in a computer. The following 
literature references describe the process of digital holography: ''Short-range 
Synthetic Aperture Imaging at 633nm by Digital Holography," published by R. Binet, 

10 J. Colineau, and J. Lehureau, in Applied Optics, Vol. 41, No. 23, 10 August 2002 and 
"Digital Off-axis Holography with a Synthetic Aperture," published by J. Massig in 
Optics Letters, Vol. 27, No. 24, December 15, 2002. 

The alternative embodiment of Fig. 6 uses digital holography to perform 
synthetic aperture imaging in real time. In this embodiment, the back-scan mirror 20 

15 of Fig. 2 is eliminated and the holographic recording medium is replaced with a one- 
dimensional detector array 26\ The interference pattern at second aperture plane 24 
moves across the detector from right to left as the platform moves from right to left. 
The image is formed through digital signal processing of the holographic interference 
pattern recorded by the detector array, thereby eliminating the readout apparatus and 

20 process shown in Figs. 3a and 3b. The signals in readout channels 58 from the 
detector array 26' are stored in a video buffer 60 and processed by an image processor 
70 to output a synthetic aperture image. 

Note that a reference beam, derived from the coherent laser, is also used in the 
embodiment of Fig. 6 to produce the holographic fringes in a manner similar to that 

25 shown in the side view of Fig. 3b. A phase adjuster may also be used as disclosed 
above. 

Fig. 7 shows a second alternative embodiment of the SAL system 10 in 
accordance with the present teachings with real time digital holography and time 
delay and integration. In this embodiment, the one-dimensional array 26' of Fig. 6 is 
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replaced with a two-dimensional array 26" configured for Time Delay and 
Integration (TDI) processing. 

TDI is a process whereby the sensitivity of a scanning 2-D detector array is 
enhanced. The process is described in several references including: U.S. Patent No. 
5 5,510,618, issued Apr. 23, 1996 to B. Belcha, et al and entitled SECOND 
GENERATION FLIR COMMON MODULES, the teachings of which are hereby 
incorporated herein by reference and an article entitled 'Infrared Search and Track 
Systems" published by J. Acetta, in The Infrared and Electro-Optical Systems 
Handbook, Volume 5, Chapter 4 p.292. at the Environmental Research Institute of 

10 Michigan, Ann Arbor, MI, 1993. 

Fig. 8a is a diagram which illustrates time delay and integration processing in 
a serial scan mode in accordance with conventional teachings. 

Fig. 8b is a diagram which illustrates time delay and integration processing in 
a parallel scan mode in accordance with conventional teachings. 

15 Acetta describes TDI in the context of a scanning infrared search and track 

system (IRST) where n detectors are scanned serially across the scene as depicted in 
Fig. 8a. The output signal of each detector is summed with the delayed output signals 
of the preceeding detectors such that each resolution element is in effect sensed by n 
detectors whose outputs are integrated together to yield a net signal-to-noise ratio 

20 increase of *n. 

TDI processing can be used with a one-dimensional focal-plane array (FPA) 
in a serial-scan or raster pattern, as shown in Fig. 8a, or with a two-dimensional FPA 
in a parallel-scan pattern, as shown in Fig. 8b. 

Returning to Fig. 7, the 2-D array 26" may be a charge coupled device (CCD) 

25 driven by a conventional TDI controller and clock 80 such that the electric charge 
produced in a given detector element by the incident electro-optical radiation at each 
aperture location is transferred to the adjacent detector element at the same rate that 
the holographic pattern translates across the CCD array due to platform motion. In 
this way, the signal from each aperture location is integrated during successive 

30 transfer steps, producing a video output with a signal-to-noise ratio that is enhanced 
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by a factor of # n, where n is the number of detector elements in the direction of 
pattern motion. The shift rate used to command the TDI controller and clock 80 is 
calculated in a similar way to the back-scan mirror rate command as shown in Fig. 5b, 
but with a multiplicative scale factor applied to account for the focal length of 
collimating lens 22 and the center-to-center spacing (or pitch) of the detector 
elements. Those skilled in the art will appreciate that the digital holography camera 
must have sufficient resolution to capture the fringe pattern created by the 
interference between the return beam and the reference beam. 

Thus, the present invention has been described herein with reference to a 
particular embodiment for a particular application. Those having ordinary skill in the 
art and access to the present teachings will recognize additional modifications, 
applications and embodiments within the scope thereof. 

It is therefore intended by the appended claims to cover any and all such 
applications, modifications and embodiments within the scope of the present invention. 

Accordingly, 

WHAT IS CLAIMED IS: 
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